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FOREWORD 



The Computar-Basod Instructional Systems Team of the US Army Research 
Institute for the Behavioral and Social Sciences performs research and develop- 
merit in the area of educational technolooy tliat applies to military training. 
Of interest are methods for training individuals to develop and utilize Instruct 
tional courseware in reasonable time, at acceptable cost. ARI research in 
this area xs conducted under Army Project 2Q263743A794 , FY 80 Work Program. 

This Research Product is one of a series of 10 volumes designed to provide 
guidance on the application of the Instructional Systems Development model. 
The work was accomplished by Mr, Ru.^sel E, Schulz and Mrs, Jean R* Farrell, 
Human Resources Research Organization, Contract No. DAHC19^78--C--0010 and 
personnel of the ARI Manpower and Educational = Sys tems Technical Area* Person- 
nel from the Directorates of Training Development at Ft, Belvoir, VA and Ft, 
Gordon, GA provided assistance in the evaluation of the work* 
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JOB ALDSi DEBCRrPTlVE AUTHORLNG FLOWCHARTS FOR PiiAHE rTT-DEVELOP OF THF 
IMHTRUGTTONAL HYHTEMS DFVELOPMKNT MODEL ' ' ' ' 



BRILF 



Requt ramont : 



To develop a Haries of job^aids for the accivities identified in the 
Instructional Systems Development Model (rSD, TRADOC Pamphlet 350^-30). 



P r o c LI d u r e * 



S A series of job aids WGre designed and developed for each of the five 
pfui|es ot the ISD model! ANALY7.K, DESIGN, DEVELOP, IMPLEMENT, and CONTROL 
Each--3ob aid is comprised of Descriptive Authoring Flowcharts and a Job Aid 
Manual which provldG specific guidance, examples, and rcferancos necessary to 
produce the product specified by the ISO Block it covers. 



Ut llizntion; 



These Job aids will be used by military .--ining personnel in meeting the 
requirements of the ISD model. " 
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mr ARB JOB AIVS? 



s Job Aids are intended to be stand-alone, step-by'Step procedural guides which 
we hope wiU permit you to turn out quality instructional products quickly 
and easily. We also hope that they will be equally useful to individuals at aU 
experience levels of the instructional systems development process, 

® Job Aids ^e intended to address reaJ needs. Prior to the development of the 
Job Aids, instructional technology personnel (individuals like yourself) at the 
U.S, Army Signal Center ^d the U,S, Army Engineer School were surveyed to 
determine specific ISD needs^those areas in which they had the greatest need for 
assistance and information. Emphasis w^ placed on satisfying these ne^s in the 
development of the Job Aids, 

® Job Aids ui.e the oame classification system for identifying the activities that 
must be performed in instructional systems development (ISD) as does 
TRADOC Paniphlet 350 30 (Interservice Procedures for Instructional Systems 
Development), 



WHAT IS THE CIASSI¥KATWN SySTEhi USEV IN TRAVOC 
PAMPHLET 350-50 AW JOB AWS? ~~ 

® TRADOC Pamphlet 350»30 suggests that instructional systems development be con- 
ducted in five phases: 

^ Analyze 

^ Design 

^ Develop 

^ Implement 

^ Control 

» For those of you \m. j are unfamiliar with TRADOC Pamphlet 350-30 we suggest 
you read the brief description of each ph^e of the ISD process as shown in 
Table 1, In the TRADOC Pamphlet each ISD phase is divided into specific 
activities call^ ISD blocks. Table 2 shows these ISD blocks and Table 3 shows 
the outcome of each block. 

® Job Aids cover the activities required for the first three phases of t^^-- 

TRADOC Pamphlet (i,e.,. Analyze, Design, and Develop instructiou. systems). 
The Aids cover each ISD block within these phases except for ISD Block 1,1, 
Analyze Job. 



' . Tible 1 

FIVE PHASiS OF INSTRLJCTIONAU SYSTEMS DEVELOPMfeNT (iSD) 

. THE FIVE PHASES ARE: 

InpLu. pfoK^i, and gutpuU In Fhw t^e ill Nitd on jeb informitiofi. An invinsory of job 
aijAee^l compile and divide Inio^o^greypi: tiiks not m\0mw^ for ^nstruetion a>d mks 

- -^^^ saiectio for instruction, Pirfsrmaf^c stiRdards for tasks seltoted for imtruciion art ditfirrnir^d 
ANALYZE or obitrvation at job sitti and virifltd by subiec! mitier experts. The analysis of 

i-i exming cour^ do€umenutlon is done lo ditirmine If ail or portions of thi inaiyiis phase and 

other phases havf alre^y been done &y someone else following the ISD guidilines. As a final 
analysis pha^ step, the list of ta^s elected for instrurtion Is analyztd for the most suitable 
instructional lening for e^h task. 



Beginning with Phase II, the ISD m^el is concerned with desionlng instruction using the jnb 
' PHASE 11 ^""V^*^ -nfermation from Phase L The first step is the sonversion of each task selected for 

D^Sl/^kl '"^^ * terminal learning obiective. iaeh ttrminal learning objective is then analyzed to 

C9!UlM detefmme jeammg objectives and iearning steps neceisiry for miSiery of the tfrminal learning 
objeccive. Tests are designed to match the learning objectivej. A sample of students is tested to 
insure that their entry behaviors match the level of learnrng analysis. Finally, a sequence of 
j instruction ii designed for the learning oftjectives. 



The instrueiienal developmenr phaie begins with the dassiffcation of learning objectives by 
Ifarninf category so as to identify leirning guideMnes necessary for optimum learning to take 
PHASE ill Oetermining how initruetion is to be packaged and presinted to the student Is 

D^lfl^l i^r% ^^o^^*^^^ through i media seiection prowls vvhich takes into account such factors as 
_ CVCLUK learning category and guidiline, media characteristics, training setting criteria, and costs. 

Instructional managemint plans are developed to allocate and manage all ^resources for 
conducting instruction. Instruttional materials are selected or developed and tried out. When, 
materials have been validated on the basis of empiricai data obtained from groups of typicir 
students, the course is ready for implementation, ^ 



PN^Q^ 11/ ^^'^^ "a'nir^S is required for the implementation of the instructional managemtnt^plan and the 
HHA&E iV instruction. Some key personnel must be trained to managers in the speeified management 
IMPLEMPNT *««ructional staff must N tnin^ to conduct the instruction and ^ollectievaluative 

ir ^^IVIdll I data on all of the instructional components. At the completion of ea^ instfuetienal cycle, 
management staff s^hould be able to ure the collected Informatisn to improve the innfuctional 
system. 



PHASE V 

CONTROL 



ivaluation and revision of instruction are carr^d out by personnel wh© preferabiy are neiihef 
the instructional designers nor the managers of the course ur^er study. The fifst activity ' 
rintirnal evaluation! is the analysis of liarner perfofmince in the course to determine instates 
of deficient or irrelevant instryction. The evaluation team then suggests lolutibns for the 
problems. In the txternal evaluation, personnel assess iob task ^rformince on tKe' job to 
determine the actual performance of course graduates and other job incumbents. All collecttd 
data, internal and exttmaU can be used as quahty contral on instructs and ^ input to ^y 
ph'M of the system for revision. 



Table 2 

ISO BLOCKS IN EACH OF THE FIVE ISD PHASES 



THl BLOO^ IN IMH PHASE AREs 



PHASE I 



ANALYZE 
JOB 



1.2 

SiLiCT 
^ TASKS/ 



Instruct. 

FiRFOAMANCE 
M^UREi 



1.4 

ANALYli 
■ iXlSTINO 
COURSii 



iiLiCT 
^iNiTNuCTlONAL 
SiTTlNO 



PHASE II 



►piViLOP 

OiJSCTIVii 



TiiTS 



U2 
. OESCRiBf , 
INTRV 
aiHAViOR 



11.4 

DETERMiNl 
STRUCTURi 



PHASE III 



iPfCIFY 
^LEARNING 

EVENTS/ 

ACTivmii 



m.2 

SPECIFY 
iNSTRUmON 
^ MANAGIMENT 
PLANii 
DELIVERY 
SYSTEM 



m.3 

. RiVitW/SELiCT 
gXiSTiNG 
MATERIALS 



N DEVELOP ^ 
INSTRUCTION 



► VALIDATE 
INSTRUCTIQN 



PHASE IV 



-► 



iMPLfMENT 
INSTRUCTIONAL 
MANAOEMgNT 
PLAN 



CONDUCT ^ 
INSTRUCTION 



PHASE V 



-► 



S.I. 

CONDUCT 
INTERNAL 
iVALUATlON 



. CONDUCT 
EXTERNAL 
EVALUATION 



2 J 
> REVISE 
SYSTEM 
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Table 3 

OUTCOMES OF ISD BLOCKS 



THE OUTCOMES OF THE BLOCKS ARE: 

,1 . - , i list ©f ta^i parfprnjid in a ptftieular job. 
.2 , ^ . a list ©f ta^es Mlicttd fei tfainif^, 

.3, , . a job ptrfermmet mtisurf for tseh task laltctad far instruation. 
.4. . . an analyiis of tfit job analysis, task iflection, and performance maaiure 
esnitruetion for any existing instruetion to dttirmine if these oourits are 
usable in whole or in part, 

.5, . . aleetion of tht inftruetional setting for task selieted for initruetion. 



I 



,1 a learning ©bjeeiive for and a Ifarning analyiis of gach task selected for 
initruetion, 

.2 . . , test items to miasure eadh learning objective. 

,3v . . a list of tntrv behaviors to ^e ;f the original assumptions were correct, 
i ^ , . , thi sequencing of all dependent tisks. 



.1... the dasiificition of Itarning ; objictives V Itarning category and the 

idintifieation of appropriate learning guidilir>es= 
.2. tht media seltetions for instructional devtiopmint and the instructional 

managemint plan for Gonduciing the instruction. 

.3.,, the analysis of packagei of any existing instryction that meets the givin 
learning objectives, . ^ 

.4... the.divelopment of instruction for all liarning objectives where existing 
mattrjils art not availible. 

,5. _ field testi^ and revised Iniiruciional materials. 



.1. . , documents coniaming information en time, spaoi. student ahd instructional 
resources, and staff trained to conduct the instruction. ^ 

,2, . . a^eompleiid cyeii of instruction with information needed to improve it for 
the succeeding cycle. 



*1 . , , data on instructional efftctivenesi. 

.2. . . data on job perform^Ci in the field, 

3. . . instructional systtm revised on baiis of empirical data. 



WHAT SOimCES 0¥ IWFORMATrOW WERE USEV IN THE 

'vBVELOvmm' of job aws? 



© Job Aidi Me not juat a re^h^h of TRADOC pMiphiet 350^30. We use the 
same elMslfication system for ISD phases md the biccks within the phases 
aj does the TRADOC Pamphlet. However, the guidance and information provided 
in the Job Aids come from a variety of sources, the TRADOC Pamphlet being 
only one such source. We have gathered information from any soiufce that we 
co^d lo^te. If the formation was judged to be good it was included in the 
Job Aids. In some instances the information in the Job Aid m based solely on the 
education^ technology experience of the project staff. 

• It is not within the scope of this Introduction to list all sources of Information 
exMained or ^ed in the development of the Job Aids, However, in addition 
to TRADOC Pamphlet 350-30 exwnples of other sources ^of infomation would 
include the following types: 

TRADOC Circulars 

^ DA Pamphlets 

— Printed Guidance prepared by TRADOC Schools (e.g., U.S. Army 
Sipial Center) ^ 

^ Army Research Institute Documents 

— HumRRO publications 

^ Other military and civiliui agencies 



^%B^CONm/§'^^^^^ At/AXIA8LE ANV WHAT VO 

• There are thirteen Job Aidi presently available. Each Job Aid is comprised 
Of documents. A brief description of each is provided below: (A 
compjevfl description of how to use each Is pven on the pages that foUow.) 

" ^^f^T&I^P^' The Descriptive Authoring Flowcharts (usually 
™ Flowchart Manuals) are the primary documents used m the 
Job Aids. They direct the user to specific guldmce, examples and references 
providea in the Job Aid Manuals, 

- Job Aid Manuals. As stated above, the Job Aid Manuals provide the specific 
bv tSln^tffth""^ references neces^ry to produce .'.e product s^fled 
or more Worksheets to use m the development of the product. 

^ • Another important part of the Job Aids package is of coum the document 
you are presently readmg, Introduction to the Use of Job Aids and Job 
Aid Resource Manual, 

• The specific Job Aids avaUable are: (Flowchart Manual and Job Aids Manual ' 

Job Aid for Selecting Tajki for Trying (ISD L2) 
Job Aid for Conducting Task Anajyiif (ISD IJ) 
Job Aid for Analyzing Existing Coursti (ISD lA) 

- Job Aid for Seleeting Instructional Settogs (ISD LB) 
^ Job Aid for Developing Oyectives (ISD ILl) 

^ Job Aid for Developing Tests (ISD HJ) 

^ Job Aid for Dticifibing Ent^ Behavior (ISD 11.3) 

- Job Aid for Detarmintog Sequence ^d Staictittt (ISD 11,4) 

" Job Aid for Specifying Le^iing Events and Activitiei (ISD IILl) 

^ ^^^^''^/Sj.^f^^" Insteuctional Managemej^t Plan and Deliver 

system (ibD IIL2) - - - j ■ 

- Job Aid for Re\rtew and Stiaction of Issting Materials (ISD IIL3) 
~ J<^b Aid for Developing Instin^on (ISD 111.4) 

^ Job Aid for Validating Instaiction (ISD IIIJ) 
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WHAT ARE THE MAW VARTS 0¥ THE ¥LOWCHAKt MAWUAL? 

• Scan through a few pagts of yom Flowchut ManuM. Obsenre the following: 

— Flowch^ symbols used 

^ InstroQtions or questions within the flowchait symbol 

— Supplemental information opposite most of the flowchart symbols 
^ Flowchart block an' page numberinf system 

• For a eompltte dtscription of aach of the main pwfta of the Flowchm Manual 
see the pages tiiat foUow. 



FLOHJCHm SYMBOLS ARE USEV W THE FLOmmT mUAL? 

FlQwehart Symbols 

~ .wi.^f ^ ^ Flowchart ManuaJ. These symbah and the 

nst^ctooni mtom them act as a road map to lead you st^p-by^tep t^ouS 
have^^o^S^ developmg your particular product. We believe that after 
eonto? H "''^ Flowchart Manual you will find it a very uSul 

control documenL. The five symbola used are as follows: ry useiui 



Start-Stop Symbal - Indicates either the itart or stop 
of the actmties c^led for in the 
Flowchart Manual. 




Dtciiiqn Symtel 



Manuil Symbol 



^ Indicates that you mmt make a 
decision at this point which will 
determine the path that you take 
thru the Flowchart Manuai. 



Indicates that you are to refer to 
the Job Aid Manual for specific 
additional guidance or instaiction 
shown in the symboL 



Recttngle Symbol 



— Indicates an activity that must be 
performed but does not rtquirt 
specific additional guidanee o^ 
instruction in the Job Aid Manud. 
(In some cases the i^er is given 
the option of going to the Job 
Aid ManuaJ to see a completed 
example of the activity called for 
in the rectangle symbol). 



Go To Symbol 



— Indicates a branch to some other 
flowchart block. The branch will 
either be to a previously encountered 
block or mil jump you over blocks 
that can be omitt^. 



ItiHAT WSTRUCrWN IS mO\/WBV WJTHW THE FLOWCHAnT 
SVMWLS? 



Each flowchart symbol except the Decision Symbol contains a brief statement 
of the activity that you are to perform. If this activity requires the completion 
of part of a Worksheet the specifie part of the Worksheet will be identified 
{remember, each Job Aid includes one or more Worksheets). Decision blocks 
always contmn a question that can be answer^ witti a^ir or no answer. The 
bmnch you take after the decision block wiU depend upon your answer. 



' 20 



miAT IS THE PURPOSE OP THE SUPPLEt^BfrTAL imnMATJON 
IN THE PLOmHART mhlUAL? 

« The supplemtnta] information that is located beside most of the flowchart symbols 
serves the following purposes: 

— Provides a more complete description of the steps or activities that must be 
performed in the ISD Block you are working in than does the flowchart itself. 

— Refeii you to specific pages within the Job' Aid ManuaJ for specific fuldanee 
examples and references ne«ied for completing the activity called for in the ' 
flowchart block. (This is associated with the Manual symbol.) 

- For some flowchart blocks (rectangle symbol) examples of the completed activity 
are shown in the Job Aid Manual. The supplemental infomation indicates the 
specific page m the Job Aid Manual containing the example. However the user 
has the option of going to the Job-md^Manual to see the example. (The Manual 
symbol, on the other hand, requires the user to go to the Job Aid Manual.) 

- Acts as an executive summary which will allow commanders and supervisors to 
obtain a picture of the activities required by the Job Aid without reading the 
entire Job Aid Manual. 



WHAT IS THE PLOWCHART BLOCK ANV PAGE mmBRJNG SVSTEm " 

• The flowchart block and page numbering system is as follows; 

— Flowchart blocks are numbered so tliat they can be easily referred to. 

- The page nurabeB in each of the 13 Flowchart Manuals are preceded by an 
identifying letter unique to a specific ISD Block.' (E.g., The Flowchart Manual 
pages for ISD Block 1.2 go from A-l to A-IB whereas for ISD Block I 3 the 
Flowchart Manual pages go from B-l to B*15.) This same page numbering system 
IS also used in the Job Aid Manuals. 
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m VO I LBE THE JOB AW MANUAL ANV WHAT .ARE THE 
mN PARTS 0¥ IT? 



• It is unlikily that you will netd to refer to every p^e m th« Job Aid MMual, 
As previouily stated, the Job Aid Mwiuali are mmi m iupplements to the Flow- 
chart ManiMi that direct you to ipecific pages within the Job Aid Man uaU. 
Therejfore, DO NOT ATTEMPT TO USE THE JOB AID MANUALS INDEPENDENTLY 
OF THE FLOWCHART MANUALS, 

9 Scan through a few pages of your Job Aid Manual. Observe the following: 

¥Bitiwl flowehMti shown at the top of pages 

Questions written in seript that apptar on most pages 

Completed, oi partially completed examples of Workshtets 



IHAT IS THE PURPOSE 0¥ THE PARTIAL FLOWCHARTS AT THE 
TOP OF SOME PAGES OF THE JOB AlV MANUAL? 

• When you are referred to the Job Aid Manual you wll find a partial flowch^ at 
the top of the Job Aid M^ual page. You are to remain working wt_1^_the Job 
Aid Manual until you come to another partial flowchart. Then return to the 
Flowchart Manual. 

• The partiid flowch^s are identical to those showi in the Flowchart Manuals 
They serve as^M additional reminder of the activity being de^t with at the 
moment. 



WHAT IS THE PURPOSE OF THE QUBSTlOm miTTEN W SCRIPT 
THAJ APPEAR ON 50ME PAGES OF THE JOB AlP MAWCMLf 

• The queations written in script we our way of teUmg you what foUows They 
highlight such thingi as: 

\ 

The pmposa of performing a certein activity 
^ How the activity is performtd 

- What sourcei art available for performing the activity md how good they are 

- What the Worksheet looks like after the activity is perfonned 

WHAT IS THE PURPOSE OF THE COIXPLETED OR PARTULLV 
COMPLETEV EXAMPLES OP WORKSHEETS? 

• As previously stated, eve^ Job Aid Mmual uses one or more Worksheets 

(located in a pocket at the back of the Manual). The Worksheets permit you to 
produce (^d document) the product called for in the ISD Block. 



Whenever you are required to make an entry on a Worksheet an example of that 
type of entry will be ihown in the Job Aid Manual and wiU usuaUy be circled so 
as to make it stand out. It is hoped that thest- examples will give you a clear idea 
of what is required on the Worksheet. 
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WHAT VOBS THIS ALL MEAN AA/P WHAT W I VO m? 



• In this Intr^uction we have attempted to explain the following: 
'^What Job Aids are 

^ The elasaificatlon system (ISD Phizes and Blocks) used in the Job Aids 
^Sources of information used in the development of Job Aids 

Job Aids preoently available 
^ A description of Flowchart Manuals 
^ A description of Job Aid Manu^ 

• If you feel that you have an adequate understendinp of the above, return to the 
Flowchart Manual now . You will be refen^ed to specific pages in the Resource 
Manual (the remainder of thm document) as you need the, information contidned 
in them. Do njot attempt to read the Resource Manual now. 

b ' ' \ 

RETURM TO THi FLOWCHART MANUAL NOW 



AIDS RESOURCE MANUAL 



\ 
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HQW CAW THE nESOUKCE muAL HBL? MEf 

The purpose of thk resource manu^ is to assist you in the formation of a data- 
b^ed iystem for decyion making in the Analysiiv Phase of the Initructional Systemi 
Development (ISD). In order to make logical and objective dtciBioni b^ed on conditions 
and netdi in the field, you must coUect, organize^ analyze, Mid document job signiflcwit 
data (information). Such data includes many specifics under the broad categoriei of 
job backpound data, tiuf et population data;, and critical task data. The specifications 
of specific data requirements and so^ces of this data should be paart of the overall 
Job Analyst Plan. 



1 



There are many sources of data to support a job analysis. 

Tii^sa source include such things as: 
, ® Ttchnicd Manu^s 
® Field Manu^s 
® Amy Refiiktiom 
^ Cir^olmfs and Phampleta 
^ Progranis of Injtruction 
^ Soldier*s Manuals 
^ Previous Task Lists 

o Documentation from the Systems En^eerinf Era 

© Reports from outside agencies, i.e.. Army Research Institute, HumRRO, 
and other miUtaty and civilian research organi^tioiiL 

® intamal Research Hearts 

_ 1 . ^. 

9 Tables of Organization and Equipment and Tables of Distribution and 

AUov/ances 

® CiviUan Publications (technical journals and professional pubUcations) 
e Equipment Modlfi«tiori Work Orde« 

® CODAP (Comprthenslve Occupational Data 'Analysis Programs) 

• Field Surveys ' 

• PantiB of Experte ' , 



mCH SOURCES 0¥ VATA ARE-^INCLUVEV W THE RESOURCE 
MANUAL? \- 

* rJ.^°%2^ ?' ^ for fuimiing speciflc needi in the Analysis Phase 

Of ISD. The Job AnalyiU Plah should specify exactly which items of data wiU bg needed 
tnd the rtcommtnded iource{s) for »oh Item.' In this way aU the dcta can be accessed and 
ready for usi m soon m it is nMded, The last thrte sources on the list CODAP Field 
Surveys, and Consensus Groups or PaneU, are frequently cited in the Job Aids for 
specific Items of infomiation. How to use these sources is the subject of this manual 
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To provide personnel manaf ers and training majiagers with the reliable job data 
naeded for job and task analysis, the Deputy Chief of Stiff for Personnel has selected the 
occupational surt^ey questionnairt for data collection and CODAP (Comprehensive 
Occupationa] Data Analysis Programs) as the system for processmg, reporting, and anal- 
yzing this data. The combination of questionnaire and CODAP is currentiy being used by 
all the U,S. Arnied Forces to support their ocGupational sun^ey and job analysis efforts. 
Tills automated data system provides information in such areas as: duties and tasks 
^rformed by job aiid duty incumbents; types of equipment, tools, and vehicles used 
and maintained; speciai skills and knowledge which must be met by job incumbents; 
quality and quantity of training received or required; physical and mental demands; and 
special items pertaininf to personal and job backpound information, work environment, 
and job satisfaction. 
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Whenever data has already been prepared by CODAP it should be used in' preference 
to school conducted sur/eys in order :o prevent duplication of effort. CODAP W the 
capability of sullying aU your data needs. It is the responsibility of each Army senice 
school to initially provide the Army Occupational Survey Propam with the input it must 
have to supply your job analysis nerts, and also to develop a job analysis plan which 
allows sufficient time to access the necessary data. 

Of particul^ t^e in job analysis are Group Summary Reports. The Job Aids 
suggest that you obtain these reports for documenting such information as: tasks 
penormed in each duty position (ask for GPSUM6 report for your MOS), and perctntage 
of soldiers in the skill level performing each task (ask for GPSUM 2) * Given sufficient 
lead time CODAP can also make up special reports to provide ratings on task selection 
factors such as, time to train OJE, consequences of inadequate performance, and proba- 
bility of emergency performance (ask for FACSUM report). 



HOW ARE COVAP REPORTS OBTAINEV? 

In order to obtain CODAP data you should first check with yo\ir supervisor to see if 
the information you need has already been accessed. If it has not, write to: 

Commander 

US Army MiUtan^ Personnel Center 
ATTN: DAPC-MSP-D 
2641 Eisenhower Avenue 
Alexandria, VA 22311 

or call: 

325^9272/9493 (AUTOVON 221-9272/9493). 

Allow at least three weeks for the reports to amve at your school The necessity 
lead time could be much longer If you requesting special information which CODAP 
has not yet collected. It is recommended that you obtain the two official guides from 
IVflLPERCEN: the US Army MiUte^ Occupational Data Bank, and the US Army Occupa^ 
tional Survey Program, 



•Kt€p in mind that thett pere€nUgis are based on tht paaeetiiTit eonditions in whiah ^ldi#r 
prtstntly being surveyiid, Adjuitmants should bt madf for combat tasks. 
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Wmi IS A FOKmL FJELV SURUEV? 



A fonnal field survey is similar to the type of questionnaire survey conducted by 
the Army OccupationaJ Survey Program, oniy it is conducted by instructional development 
personnel within an Army service schooL 

The use of questionnaires permits the job analysis team to make limited contact with 
large numbers of personnel; thus large amounts of information can be collected at a rela- 
tively low cost. Questionnaires can be mailed to personnel who are ^ked to complete 
and retum them, or they be administered to froups of job incumbents and/or super- 
visors by local personnel who have the responsibiiity and authority to make sure all 
questionnaires are complete and returned. 



WHEN SmULV FOmAL FIBLV SURUEVS BE LBEV? 

Whenever time does not allow you to access information from the Army Occupa- 
tional Survey Program, an alternate data collection method may be usad. Formal field 
surveys are suggested as an alternate data source in the ISD Job Aids, Should you decide 
to conduct a formal field survey be sure to obtain permission from MILPERCEN in 
accordance with the g^iidelines in AR 600-46 = 



0 Typeg of Quertionnaires 



There are two types of questionnaires, the closed form and the open form. We 
suggest usmi the closed fonn, which contaiiis a list of possible items to be selected or 
blanks to be filled in with words or numbers. (For an example of a closed form ques- 
tionnaire, see Appendbc A.) This form has several advantages over the other alternative, 
the open form. It is Ukely to take a minimum amount of time to fill out thus increasi'nf 
the chances that it will be completed and retumed. The process of tabulating and sum. 
manzing responses ij simpler a,id less time consuming than with an open form questionnaire 
Machme tabulation and computer analysis of the completed forms are practieal when a 
large number of questionnaires is usfd, 

A properly designed closed form questionnaire is difficult to prepare The designer 
must be sure to include aU possible responses expected from any of the soldiers who 
will complete the questionnake. The items must be consti-ucted on the form so that 
they clearly communicate to the user exactly what the designer is trying to ask. The 
neatest smgle problem with research methods is improperly worded questionnaires as they 
produce faulty data. If you intend to design your own questionnaires we sugeest consult- 
mg the following gmdes: 

Morsh, J.E. and Archer, W.B. Procedural guide for conducting occupational 
surveys In the United States Air Force fPRL-TPw.67.11). Lacklajid Air 
Force Base, Texas: Personnel Research Laboratory, Aerospace Medical 
Division, Air Force Systems Command, September 1967. 

Jacobs, T.O, Developing questionnaire items: how to do it well. Human 
Resources Research Organisation (HumRRO), 300 North Washington Street 
Alexandria, Virginia 22314, ' 
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The details of the forms you use wUl be dttermmed by: 

1. how you will Ubulate and smnmarize the resuits, and 

2, what information you wish to coUact. 

How you vdll tabulate and summarize results will be determined by whether you 
have available a computer and other automat^ data handlini equipment and by the 
number of people surveyed. To detirmini whet informition you wiih to colltct, you 
should insider the total date requif^mmt for tht training dtvslqpment pro^si. Tha^ 
data requirements ihouid bi pr^eterminid In the job analysii plan so that as much Infor- 
mation as possibie ba ab^ined in a singli questionniire sus^ey effort. 

One note of caution about the design of your questionnaire is that you should keep 
the questionnaire as short as practical. In gener^, the forms should be designed so they 
can be completed in two hours or less. One way you can save time on a complex 
ta^k inventory is to list all t^ks under their appropriate duty position title. This 
will permit the soldier to rapidly scan groups of tasks not performed and then pro- 
ceed to the next duty position. 



WHAT TVPE OF WSTRUCnONS FOR COMfLBTlNG ANV 
, AmWJSTERim THE QUBSTlONNAmES SHOULV BE PRcPAREPf 

After the tormai field survey questionnaires have b^n written, the instructions for 
conipleting and administering the questionnaires should be prepared, Th j3 instructions 
should include: 

® For the user an introduction explaining the pu_rpose and 

importance of participating in the field survey. 

^ general instructions explaining how the questionnaire 
is to be completed. 

* For the project offleer ^ general instructions regarding responsibilities. 

(When questionnaire is ^ specific instructions for administering the ques- 
not self-administered) tionnaire in a controlled environment. 

For examples of these types of instructions, see Appendix B. 



34 



You are now ready to select organisations and individuals to provide you with the 
needed job data. The complexity of the MOS, the availabUity and quality of published 
purees of job mfomation, and the number of people in the particular job will determine 
how much and what kinds of information you need to collect This wiU strongl' 
influence the make-up and size of your sample. If the complexity and amount of required 
data are great, the number of organizations and individuals interviewed wiU increase As ' ' 
a general rule, your survey sample should be as larBe as poMible. This is particularly true 
If you Qo not have personnel available with the responsibility and authority to assure that 
most of your questionnaires wiU be completed. You should make an attempt to obtain a 
sample that represents the distribution of individuals in the MOS according to command 
and skull level. Review of personnel records, cither by personnel employees, members of 
your job analysis team, or your field representatives who will conduct the survey will be 
required to obtain data upon which to base choices for your survey. 

o In selectmg UNITS for sampling, you should select units that: 

1. have at least a small number of job holders and supervisors who do the 
particular job to be analyzed. Preferably, you should choose some units 
that have a relatively small number of job holders, and some that have 
large numbers. 

2. are geographically and environmentally representative. 

« In selecting INDIVIDUALS within the units, you should select a rroup made up 
of individuals who: 

1. perform and supervise the job being analyzed 

2. perform with average satisfactory proficiency 

3. are representative in terms of length of time on the job 

4. are representative in terms of training. 

For certain types of information you will also want to choose at least a few job holders or 
supervisors who are acknowledged eiperts at the job. ' ' 



''1 



27 



ERIC 



HOW IS A QJJESTIOmAJRE SUWEV CONVUCTm 



^ Trial Run (Validacien of Inrtrumanti) 

Bpfore sending out the total number of qutstionnaires you intend using, you may 
wiah to se.. out a small number. This will pennit you to check the initial results and 
^ssibly make some changes in your questionnaires or instructions. Then you will send 
out what you hop^ will be the total number of questionnaires required. 

^ Group Admin titration 

The ideal way to udministsr questionnaires is poup administrEtion. Whcrs the 
local responsible official and his assistants schedule the administration he should do 
the following: * 

^ Make certain that only eligible individuals are seated in the administration area 
^ Read the administrative instructions 

^ Provide any necessary a^istance in completing the questionnaires 
^ Return the complete questionnaires to the school 



^ Individual Adminii^tlon 

Often, particularly with individuals it remote stiitlons, poup adoainistoation m 
impractical. In these caBas^ it is sometimei effective to ^nd the questionnairei to a 
responsible officer and request that toey be retiufned by a re^nable suspense date. 
C^ful attention should be psdd to the initructions for administomtion ©r ielf- 
^ministration. If your commMd has no authority to require that a suspense date 
be jnet, then you must either obtmn the concurrence of a command with that 
authority, or be wiUing to accept a reduced ^rcentage return. 

• Riturn of Qutitionnalres 

How much confidence cm y^ i have in the validity of your questionnaire if you 
get less than a 100 percent retmi? Less and less confidence can be expect^ with each 
reduction in the percentage returned. What can you do if you are not ^tisfied with the 
percentage of returns of the qu^tionnaires? We iuggest you try the following; 

1) Send out more forms to different people md hope for better resulted 

2) Recontact some of the first ^Lmple and tj^ to encourage them to retmrn 
the questionnairei, - 

3) Visit a rMdom smple of those who did not respond and compare their 
forced responses with the voluntary responses. Then you md your super- 
visors will have to decide how much ehmce you are willing to take that 
the data you have received presents a sufficiently accurate picture of th? 
job as it really exists. 
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WHAT IS A PANEL OF EXPERTS? 



With thm method a group of perionnel, selected for their txperience and knowledge 
of the job, is broitght taiether to confer about the required job analysis data. Panels may 
be made up of one or more of the following types of members: 

1) Subject Matter Experts (SMEs) 

These Bie perKjnne! found at your ichool who are acknowledged experts 
in the tasks, duty positioni or MOS you are analyzing. They may be 
found among initaictots or ISD personnel who hold the MOS. SMEs 
may or may not have had recent field experience, 

2) Job Ihcumbents 

This group Includes those who are presently holding the jobs/perform:'ng 
the tasks/ you are interests in, or who have recently held the jobs. The 
more recent the better. More than three years away from the field would 
disqualify a potential panel member. 

3) Job SupervisQrs 

This jpDup includes those who are presently or have recently (within the 
past three yem) supervised loldieR in the jobs/tasks you ae interested in. 

Job incumbents and job supemsors may be found on the post where your school is 
located or at other locations. Check the TOEs and TO As to find out where personnel 
may be a^ipied. While perionnel assipied to your post are most conveniintly afisembled^ 
they may not be completely representative of job incumbents/superviaors serving in other 
locations. Also, they probably have been hea^dly burdened by sehpol iwreys/pwels, etc., 
^^ady due to their proximity to the school. Therefore, j^rsonnel from other locations 
may have to be used. 
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WHBN U A PAhlBL USEVf 

Panels of experti are a good altamate data source when: 

— CODAP is not availablt 

— time and funds are inadequate for conducting a field survey 

— the type of information r^uktd can be reliably provided by a small poup 



WHEN Am SUBJE^ MATTER E^mTS USEVf 

t 

With this method, a poup of highly experienced personnel is brought together to 
record and organize the requteed job an^ysis data. This method is particularly useful in 
collecting job data on new jobs or on managerial Mid supen^isory jobs where many of 
the most critical behaviors are not directly observable. Since the members^f a panel of 
SMEs are experts in the MOS being analyzed, their collective effort should be decisions 
about the requirements of the job. In general, their peateit effectiveness is in evaluatini 
and making decisions about job data that have been collected from other sources by 
other msMs, 



WHEW ARE mCEhTT JOB INCUmEtrrs ANV/OR SUPEmsOKS USEV? 

With this method, a group of job incumbents, job supenrtsore, or a combination of 
these, IS brought together to provide information about their Jobs. The primary functiori 
of this type of panel is to provide information about their jobs, not to make decisions 
Another name for this type of panel is Consensus Group. ' 



HOW IS A PANEL ASSEmLEV? 

The panel is a relatively ineKpensive and easy approach to collecting data. Three to 
seven persons is the number recommended to m^e up the panel Whenever possible, you 
want panel members to be representative of different locations types of units in the 
field. While msny experts may be aTOUable within your school it is critical that their 
mwB be balanced by those of pe^ns serving presently or recently in the field. If all of 
the panel members come from schools, there may be a tendency for the outcome to refleqt 
what exists in training rather than what actually existe on the job. - 
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Appendix B 

ADMINISTRATIVE PROCEDURES 

FpR 

CLOSED FORM QUESTIONNAIRE 

\ 

1, Introdu^on (for uisr of qu^onnaire) 

2, Genera! In^t^cttons (for u^r of quartionnairt) 

3, Gemral In^uotioni (for projeet off sew) 

4, Spdeifis instru^ioni for Adminiitef ing Queitionnaire 
(for projwt ottiMr when quettionnaii^ Is administered 
in a aonwiied environment. 
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TOi USER OF QUfSTIONNAIRE 



INTRODUCTION 



TO THE NONCOMMISSIONED OPFICiRi 

Thii questionnaire is part of a fltld survey designed to identift? tasks for military 
pMDlice training. Its spectfio purpose is to obtain from you, the Noncommissioned Officer, 
information on task criticallty Md frequeney of perfomance. Feedback gained from 
this questionnatft will play a major part in redtiigning the Noncommissioned Officer 
Advanced Education System. The ultimate gori m to design toining so that it reflects 
what we have learned from you In the field. , This goal is po^ble only wito your full 
cooperation. Consider each tMk listed in thii questionnwre c^efully and give yot^ best 
response. Yoiu: contribution is essential to a successful survey. 
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TO: USER OF QUESTIONNAIRE 



GENERAL INSTRUCTIONS 

Complste this survey questionnaire within the time specified by your unit project 
officer and return it to him upon completion. 

Because instructions. for completing each part of this survey questionnaire are 
different, read aU instructions carefully, 

Part II requires that you supply biographical information. This Infofnation will be 
used to correlate feedback received from the field, ^t aU answers ih nhe spaces 
provided on the appropriate survey questionnaire page. 

In the upper right comer of each page of Part III, Task Inventory, of this survey 
questionnaire is a BOOKLET NUMBER block. Immediat«ly to the left of this ' 
block is the individual booklet number. Print the individual booklet number in the 
BOOKLET NUMBER block on each page of the Task Inventory as demonstrated in 
the example. 



EXAMPLE^ 



(000345) 





BOOKLET NUMBER 




0 


1 


2 




4 


5 


6 


7 


8 


9 




0 


1 


2 


3 


m 


. 5 


6 ' 


7 


8 


g 




0 


1 


2 


3 


4 


■ 


6 


7 


8 


9 



5. Part III, Task Inventory, is divided into nine (9) separate sections (Sections MX)., 
The content of these sections concerns tasks you may perform in your present duty 
assignment. You are asked to rate each task in accordance with three criteria - 
frequency of task performance, immediacy of task performance, and importance of 
task to mission success. • 



Base all selections on your experience in your present duty assignment. 

a. Column A requires that you rate how often you^ perform each task on a scale 
from one to four. The criterion for this rating is the frequencj^;,of task per- 
formance. Those tasks performed most frequently wiU normally' be rated four 
while those tasks not performed at all will be rated one. 
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b. CQlumn B requirti that you determine how soon you must be capable of per- 
forming each task ^ter re^rting to your present duty asiignment. The cri- 
terion for this ratinf is the immediacy of task perforaaance. Of the four 
possible reiponsf i, select the one most nearly describing your r^uiremen^. 
Select responie number four for those tasks which you must be capable of 
performing immediately upon reporting for duty. Select response number one 
for those tasks which you never perform. 

c. Column C requkes that you describe, in your opinion, how impoitoit each 
ti^k is to mission success. The criterion for this rating is the important of 
the task to the accomplishment of the unit mission, Those taskf that, in 
your opinion* bib most Important to mission sUccess will be rated four while 
those tasks that you consider least important will be rat^ one . 

6. After selecting, enter your responses for each task, using either a pen or pencil. In ^ 
the answer portion adjacent to the appropriate task statement as demonstrated in 
the example. 

EXAMPLE r The task PREPARE CORRESPONDENCE , if rated as performed 

FREQUENTLY in Column A, identified as must be capable of performing 
. IMMEDIATELY in Column B, and determine by you to be MOST 
IMPORTANT in Column C, would be entered in the ansM^er portion, as 
shown below, 

PREPARE CORRESPONDENCE 1 2 3 4 1 2 3 412 3 

DDDIDDDIDaD 

7. After each section of Part III, T^k Inventory, is a Write-in Section, . The^ writenn 
sections are provided in order that you may comment on each t^k inventory section, 
or list any task(s) you think should be included in the Task Inventoi^, These sections 
also allow you to comment on those tasks that you find we the most difficult for 
you to perfom. 



40 " ^ 

■ 46 



TO: PROJECT OFFICiR 



GENiRAL INSTRUCTIONS FOR PROJECT OFFICiR 

1. General. The MsUtary Police School is currently involved m rtdesipiini basic 
raiUtary poUce training to produce military poUcemen better equipped to perforni ' 
when they reach the unit. The emphasis is toward training replacenients in tasks 
actually being performed in the field. The questionnaires in this packet are desimed 
to identify those tasks. 

The care with which you, the project officer, administer the questionnaiies wiU 
determine the accuracy of field foedback and, consequently, the success or failure 
of this project. 

2. Survey Packet Contents . 

a. Questionnaire 

b. Supervisor Questionnaire 

c. Project Officer Instructions 

d. Answer Sheets for Questionnaire 

e. PencUi for use on answer sheets. 

3. Responsibilities . 

a. Unit Commander . The unit commander is requested to appoint a project officer 
and to monitor administration of the survey. 

b. Project Officer. The project officer is responsible for the control and handling 
of questionnaires, for the administration of the questionnaires, and for returning 
completed and imused questionnaires to the Military Police School. 

^' Questionnaire Administrator. The project officer may appoint someone to 
administer the questionnaire, if necessary. Normally, however, it is recom- 
-mended that the project officer administer the questionnaire himself. 

4. About the Questionnai res. 

a. Questionnaire. This questionnaire is desipied to identify tasks being performed 
by military policemen In the field and the frequency with which each task 
is performed. / 

b„-^ Supervisor Questionnaire. The supervisor questionnaire is proirammeci to pro- 
vide feedback on task cnticality, probabiUty of deficient performance, and the 
frequency with which each task is performed. 



5. ^ Who Takes The Qugstionnaire. The projtet officer is reiponsible for stltctlng 

mdividuali to takt the-questionnakti (respondent) within their units. Those 
lalected must mtet the requirementa listed below: 

a. The questionnaire respondent must: 

(1) Be in an MJ, duty aiiignment (actutUy performing M.P. dutlei) 

(2) Have been on the job at least 90 days 

b. The reipondent to ^e Su^msor Questionnaire mi^t: 

(1) Command or superb M,P. pe^nnel 

(2) Have been in a command or supervisory position in the imit for SO days. 
(Assi^ quastionhalres proportionately wnong officers and NCO's.) 

6, Questionnaire AdminiBtration. 

a. Questionn^ > The questionnatfi wiU be ^ministered in a conteoUed environ- 
ment/ Persons participating in the survey will be ^owed two hoias t© complete 
the questionndre and will turn the questionnaire and answer sheets in to the 
questionnaue adminlsttator prior to leaving the survey area. Individual question^ 
xmxm and their accompanying answer sheets will be kept together. 

See atteched item for the procedure to be followed in administering the 
qutstionnidre. 

b. Supervisor Questionnaira , Suptrviso^ selected m reipondents for thta ques^ 
tionn^e wiU be allow^ to sign for the questionnatet and take it with them. 
They ^11 complete the questionnake and retiro it to the project officer within 
a time frame hs specifies. This time frame must be compatible with the 
suspense date to the Military Police School. 

7^ Questionnaire HMdUng . Questionnatees and Mswer shette become FOR OFFICIAL 
USE ONLY when completed. For ease of accounting, each questionnaire and its 
accompanying Mswer sheets are numbered, AU questionnaires must be returned to 
the Milita^ Police School whether they are used or riot, Instaictioni for returning 
the questionnakes to the Milit^ Police School are eon^ned in the basic letter. 
If you have any problems or questions, contact (NOTE: Give name or names, 
address, and telephone number). 
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"""^ mvmONmN^^^ administering QUiSTlONNAIRl IN A CONTROLLED 



A-l. 



A-2. 



ADMINISTERING THE QUESTIONNAIRE 

E|^ti£n A classroom or training room equipped with desks will provide the 
and tw , \dmmisterini the questionnaire. Questionnaires, answer sheets 

"fo ta^e tf"!"" *° participants afteVeveryone who 

IS to take the quest,onnau-e has artved. This ensures that eve^one startT togerher, 

InmStim The questionnaire administrator will present the following instructions 
a. "Is there anyone here who is not working in an M.P. duty position' Is there 
^y^ne here who has not been assigned to their present ItLs at least B^d^s' 
If 50, pie^e leave at this time.'* ^ uayb, 

h^hrstti^'if"^ ^'^"^ '^'^ — which 

(&Jote to the administrator- It must be emphasized .that .your enthusiasm for ' 
th,s project or lack of it .will be contagious. It is important that you ?^on 
strate a positive attitude to the participants. Allow time for the Lt pLe to 
^i^r^r the importance of the questionnaire with the f^ing 

"I woi^d like to stress the importance of this, questionnaire. The Military' ' 
Police School wants to design, training to fit the job in the field. You 7b 
the. only people who can tell them what they need to know. Please think 
through each question and give your best answers." 

. "Turn to Part I, Biographical Information, and answer questions 1-13 

^^c^^lu'^'^f' °" ^'"^ I know when • 

to proceed to the next step/' 

. ''Now read the mstructions found in Pm IL" 

LX^toth^t;::'!"^" "^"""^ -"^o"' '» «„ish before 

*'Are there any questions?'* 

"As you read In the instouctions. there are nine answer sheets accompanying 
yo;^ questionnaire. Take the answer sheets and number theft one tl^S 
mne to correspond to the first nine sections in Part III of tlJe ^uestionn^ 
. f you do not have nine answer sheets, raise your hand-I have extra ones 
Use a separate answer sheet for each section. Answer only the number of 
ques lons listed in each and move to the next section and'answer^^t It 
^ aaLnecsi^ to write your name, rank, the date, or coi^e at the top 

Doint' ""7" f"' the blocks marked score, grade. exL 

points, and ycml secunty number.'* ^ — ^ 



f. "Because of the si^e of this sunfey, these answer ihet ts will be read by 
machine. You must use the special pencils provided so that the machine can 
read the answers. When marking yo^ answer, take care to fill the vertical 
rectangle outlining the letter as shown by the example on -page 4 of the 
instructions. Also, please be sure not to make any stray m^ks on the 
answer sheets. Finally, do not fold the answer sheets." 

g. "All answers must be based on your experience in this your present unit. Do 
not call on experience in previous units. This means that if you do not per* 
form a particular task in your present unit, you rai^t mark 'do not ^rform 
this t^k* on your answer sheet." 

h. "You may begin answering Prt III. Remember Section ten, the written 
section. When you finish answering all questions, insert your answer 
sheets into the questionnaire and turn them in to me. You may leave 
when you are finished. Are there any questione?" 

A-3, Conclusion . After everyone h^ taken the questionnaire, ensure that all ques^ , 
tionnaires and answer sheets are accounted for. Collect the pencils provided so 
that, they may be returned to* the Military Police School along with the question- 
naires and answer sheets. 
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JOB AIDS- 
DESCRIPTIVE AUTHORING FLOWCHARTS 

ISD III.1 Specify Learning Events/Activities 



r 



This is the 9th in a series of ISD Job^Aidi for use in instructional design and 
development. This volume will direct you to specific guidance, examples, and references 
provided in the supplementary manual "Job Aid for Specifying Learning Events /Activities 
ISD IILl,?'- If you do hot have the supplomentary manual^ request it from your supervisor. 
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ISU II!, 1 Specify Learning ivents/Activities 



Have 
^You Read the" 



Introduction 
of Job Aid: 



the Us 



No 



Yes 



This intmductixin pToM des Vm user with 
instruction on the bpslc structure otthe 
Job Aids and Guidan',^B fo; their use. 



Introduction to the Use 
of Job Aids 



Refer to Introducljon. 




No 







Yes 






5 






Overview of 


.earning 




Activities Joh 


Aid 















Overview includes: 

- Objectives 
Purpose 

= Product 

- Major staps in process 

- Worksheets used 



For detailed overview, see Manual, 
page 1-4. 
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List of 
Cfitica! Tasks 
""and AssQciatid TLOs and^ 
LOi Avaiiabie 



Yes 



No 



Guidance f^r Obtaining/ 
Preparing Critical Task 
List and Associatod 
JLOsand LOs 



Select First/Next Crltlca 
Task Wittr AssDciated 
TLOs and LOs 



Obtain First/Next 
Learning Activities 
Recording Sheet 
(LAR Sheet) 



10 



Compiete Section I of 
LAR Sheet 



List of critical mks and associated Terminal 
Learning Oblectives and Loarning Objectives 
should be available as output from ISO IL1 
Develop Objectives, 

If Learning Objectives are not available for 
mi critical tasks, go to Job Aids: Descriptive 
Authoring Flowcharts ISD ILl Develop 
Objectives. 

When Learning Objectives have been obtained 
return to Block 6. 



Learning Objectives for each critical task are classified by learning category and 
sub-category. Appropriate learning activities are then specified for each Learning 
Objective. The Learning Activities Recording Sheets (LAR) are used to record 
the.^e data. 

For guidance In obtaining LAR Sheets, see Manual, page 18, 



Information required in ruction I of the LAR Sheet is: 

Name/Office Symbol 
- Date 

Course under development 
^ M OS/Skill Level 

ixarnple: See" Manual, page 1-9. - 



1^4 
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11 


1 ■• 


Complete Section II of 


LAR ShBit 




12 









Itfentjfy Record First/ 
Ne?<t Learning Objective 
[Col. A, Section III, 
LAR Sheet] 



ISD 1 1 1. 1 Specify Leaming Eventi/ActiWtles 



• Information required in Section II of the LAR Sheet Is' 

- Task ID No. 

- Terminal Leirnlnfl Objictive (Action Statftment Only) 

• Example: See Manual, page 1-9. 



• uf s£'""'"« ^""'"^ 

• For further guidance, see Manual, page 1-10. 




15 



Determine/Record 
Learning Category 
[CoL B, Section Ml, 
LAR Sheet) 



14 



The three learning categories are 

- Mental 

- Physical 

- Attltudlnal 



Charactirlstlcs of 
Learning Categories 



To determini the characteristics of each of 
the three learning categories refer to the 
Manual, page 



One of the following three learning categories is recorded in Col. B of the 

UAH dneet: 

= MENTAL 
- PHYSICAL 
^ ATTITUDINAL 

For further guidance in detarmlning and recording appropriate learning 
category, see Manual, page h12. ^ f-f- h ly 
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US 



16 




Yes 



17 



Determine/Rocord 
Sub-Category 
[ Col. B, SBCtion 
LAR ShBBtl 



18 



Ditermine/Record 
Appropriate Learning 
Activities 

[Col. C, Section 111, 
LAR Sheet] 




The MENTAL learning category h subdivided 
into six subcategories. They are: 

- identifying objects and symbols 
= recalling information 

- diicriminating 

- classifying 

- rule-learning and using 

- decision-making 

For examples of each subcategory, see Manual, 
page hi 4. 



Learninq Activities necessary for teaching the 
learning objectives associated with each of the 
six subcategories of the MENTAL Learning 
Category are prepared and recorded on the LAR 

For further guidance in preparing and recording 
appropriati learning activities, see Manual, 
page 1-17, 
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ISD MM Specify Learning Events/Activities 



Learning Category 
'Physicaj" ^ 
? 
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DDtgrmine/RecorcJ 
Sub-Category 
[CoL Section ill 
LAR Sheet] 
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Determine/Record 
Appropriate Lsarning 
Activities 
[CoL C, Section 
LAR Sheet) 




The PHYSICAL learning category is sub^ 
divided into two subcategories. They are: 
= gross motor skill 
= responsive motor skill 

For BKamples of each subcategory, see 
Manual, page (-2B. 



Learning aetivitles necessary for teaching the 
learning objectives associated with each of the 
two subcategbries of the PHYSICAL Learning 
Category are prepared and recoided on the 
LAR Sheet, 

For further guidance in preparing and recording 
appropriate learning activities, see Manual 
page \-2B. 
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Yes 
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Lenrnincj Category Must 
Be "IVIental", "Physical" 
nr "Attitudinal". See 
SuperviSDr for 
Assistance. 
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RHCord Subcategory 
[Col. B, Section lit, 
LAR Sheetl 



There is one subcategory under the ATTITUDINAL Category, it is: 
- attitude^learning 

For examples of this subcategory, see Manual, page 1^34. 
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Determine/ Record 
Appropriate Learning 
[CoL C, Section 111, 
LAR Sheetl 



Learning Activities necessary for teaching the learning objectives associated with 
ottitude^Iearning are prepared and reicorried on the.LAR Sheet. 

For further guidance in preparing and recording appropriate learning activities, 
see Manual, page ^36, 




Yes 



ISD IIM Specify Learning Events/Actiyities 
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Have 
All Critical 
Tasks Been Examined 
? 






Yes 


32 





Revise LAR Sheets 
As Necessary 



33 



Revise LAR Sheets 
As Necessary 



34 



Any 
'Information 
Individuals Working i 
.Other ISD Blocks 



No 



Yes 



35 



Record Comments on 
ISD COORDINATION 
SHEET 



^ STOP 



puring the instruction activities selection pm^^s 
information may have been obtained that woui^ 5^ 
useful to persons who performed activities that fgd 
into this step. Similarly, information may have 
been obtained that would be useful to persons 
will be engaged in Instructional Systems DevelQn 
ment steps that follow this one, " 



Comments are recorded and submitted 
appropriate persons. 

For further guidance, see Manual, page 14] 
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JOB AIDS: 

DESCRIPTIVE AUTHORING FLOWCHARTS 

!SD IIL2 Specify Instructional 
Management Plan and Delivery System 



This is the 10th in a series of ISD Job Aids for use in instructional design and 
development. This volume will direct you to specific guidance, examples , and references 
provided in the supplementary manual '*Job Aid for Specifying Instructional Management 
Plan and Delivery System ISD If you do not have the supplementary manual, 

request it from your supervisor. 
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ISO 1IL2 Specify Instructional Management Plan and Delivery System 



r 



START 




OverviowQf Instructional 
Management Plan and 
Dulivery System 
Job Aid 



• For dotyilHfj overview, sue Manual, 
pages J 4 thru G. 



GO 

J^3 



^Dg You 
Have Cofiipleted 
Learning Aciivilies 
Recording Sheets 




No 



Obtain Learning 
Caiegory iVlatrices 



9 




Scleci First/Next 
Learning Activities 
Recording Sheet 


10 









Obtain Delivery System 
Planning Sheet 
(DSP Sheet) 



B These slieets describe the learning activities 
sutjOGstGc] for every leorntiig objective within 
ii single task. 



GuicianCB for Obtaining/ 


Preparing Learning 


Activities Re 


cording 


Sheets 





Learning activities far each task should be 
available as output from ISD IIM Specify 
Leoining Events/Activities, 

If procedures for specifying learning activities 
were not caniplete, go to Job Aid: Descriptive 
Authnring Flowcharts, 1-3. 

When lists of learning objectives and their 
correspanding learnifig activities have been 
obtained,- return to Block 6. 



e Learning Category Matrices are available for all nine learning subcategories. 
They are used to select the most appropriate delivery system for training each 
task. 

# For further information and guidance on obtaining Learning Category Matrices, 
see Manual, pages J^8 and 9. 



Delivery System Planning (DSP) Sheets are used to document candidate delivery 
systems which meet the criteria specified by the learning artivities for each 
objective. From this group of candidate delivery systems the final selection of 
delivery system{s) for the whole task is made. 

For guidance in obtainirj^ DSP Sheets, see ManuaL page J-tl, 



J. 4 
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ISD II 1.2 Specify Instructional Management Plan and Delivery System 
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CompletB Section 
DSP Sheet 



of 



12 



© Identifymg information includes: 
= MOS = Date 

- Skijj level Task LD, number 

= Course title = Instructional setting 7 Actlvilies Recording Sheet 

- Name/Office Symbol 

© For example, see Manual, page J-12. 



^ located on Learning 



Record ALL Learning 
Objective Action 
Statements 
[Section III (A), 
DSP Sheet] 
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s For further information and guidance, see Manual, page 



Select First/Next 


Learning Ot 


jjective 


Action Statement 


[Section III 


(A), 


DSP Sheet] 
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Record Learning 
Category and Subcategory 
[Section III (B), 
DSP Sheet] 



IS 



For further information and guidance, see Manual, page J-IB, 



Locate Appropriate 
Matrix for This Learning 
Category and Subcategory 
[Learning Category 
Matrix] 



« The matrix js located for the learning subcategory which has an X in 
Section III B for this objective. For eKample, if there is an K in the 
column for Gross Motor Skills, then that is the matrix to be used. 



16 



Record Appropnate 
"Training Setting 
Criteria" ( Learning 
Category Matrix] 



® A light check mark ( s/ ) is made on the matrix to indicate ihi criteria 
specified by the instructional setting and learning activities for this objective, 

e For further guirinnce, see Manual, pages J-l? and 18. 
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Record AppropriDto 
"Administrative Criteria' 
[Learning Category 
Matrix) 



A light check mark {%/) is made on the matrix tn indicate the criteria 
specified by the instruuiional management plan for this objective. 

For further guidance, see Manual, pages and 20* 
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Does 
Matrix Contain 
'Stimulus Criteria'^ 
? 



No 



Yes 



19 



Record Appropriate 
"Stimulus Criteria" 
[ Learning Category 
Matrix] 



All matrices include Stimulus Criteria except: 

- Subcategory Identify Objects and Symbols 
(Mental Skills) 

- Subcategory Gross Motor Skills (Physical Skills) 
Subcategory Attitude Learning (Attitude Skills) 



A light check mark ( ^/ ) is made nn the 
matrix to indicate the criteria specified by the 
learning activities for this objective. 

For further guidance^ see Manual, page J'21. 
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Examine "Alternative 
Instruciionnl Delivery 
Sysiems" 

[ Leornlng Category 
Matrix] 
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Draw Line Through Any 
Delivery System{s) Clearly 
Not Available for Training 
This Learning Objective 
[Learning Category Matrix] 



Record Appropriate 
"Camplexity Criteria' 
[Learning Category 
Matrix] 



A light check mark { v' ) is made on the 
matrix to indicate the criteria specified by 
learning activities for this objective. 

For further guidance, see Manual, page J*22, 



There are wm groups of alternative instructional delivery systems: the first group 
consists of those which meet all the criteria completely; the second group consists 
of delivery systems which are adequate but do not meet the criteria completely. 

For further explanation of the delivery systems, see Manual, pages J^23 thru 25. 



For further guidance, see Manual, pages J 26 thru 28, 



24 



Examine First/Next 
Pateniia} Instructional 
Delivery System 
I Learning Category 
Matrix] 



For further nuidance on examining delivery systems for suitability, see Manual, 

pageJ^29. 




• For example, see Manual, page J-SO, 



U7 



26 



Reject as a Candiduto 
DeNvory Sysieni 




9 Far BHLinipiB, soG MadUtil, page J^31 . 



Yes 



28 



Reject as a Candidate 
Deliyefy System 
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ISD IN, 2 Specify Instructional Managament Plan and Delivery Systarti 



31 



Reject as a Canriiriate 
Deiivery System 




Yes 



33 



"Pre-recorded 
Opposite Each 
^CompleKity Criteria' 
sYou Checked 



Yes 



For exomple, see Manual, page J-35. 



No 



35 



34 






Reject as a Candidate 
Delivery System 








Record the Delivery 
System on DSP Sheet 
[Sectiun III (C), 
DSP Sheet] 



For guidance in recording the delivery system on DSP Sheet, see Manual 
pageJ-3B. 




Have Al 
Instructlona 

Oeiivery Systems 
^Been Examined 
? 




e Are therg defivery systems shown under the 
Aiternative Instructional Delivery Systems that 
have not been examined? 



38 



Repeat Blocks 24 thru 36 
and Select the Delivery 
System Which Has the 
Most "Xs" Opposite 
Your Checks 



* This block i^ included in the event that no 
avaijablrdehvery system could be found by 
using th^ algorithm. The more delivery 
systems that were cros^ied off t^^e list the 
more likely this is to happen. Then a less 
than perfect choice must be made. 




Actjon Statement on 



No 
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Erase All Checks on 
Matrices or Get New 
Sheets 




Matrices are used mop than once in order to 
reduce the amount o^aper used with this 
job aid. 



ERIC 
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EXiimifju AH Action 
STntnmenfs unci Cjndifjutu 

Delivufy SyStLMTlS 
ISuctiun ill (A) L). 
DSP Sheet 
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Than One 
Dohvery Systuni MgqC 
Mcfha Seloction Cfiterin^ 
For Objectivcs^^ 



No 



44 



Rucnrd thu Stjluctiirl 

HiG Bnsis for Your 
DfiCisiun [StHJtinn 
OSPShontl 



45 



Is This 

^^^^^ Th,-; Lijiit UTirnnHj \. Mu 
Activtrifis Wofkshufit 



ISD IIU Specify Instructional Manay:>ment Plan and Deliverv System 



s For funhor yuiduncf^ on tho pufpose of this ■. amination, sue Mamu)!, piigo 



43 



Dues more tl)aii one ddNvery system moet tlie 
media selectian criteria lor iliis group of 
objectives? 



SclGct the Best Dehyery 
System(s) for This Group 
of ObjectlvBs 



For guidance on liow lo select the best 
delivery sysiem, see Manual, pages 
J^41 thru 43. 



Far furthnr nuiclancn and example, see Mnnual, pnge J-44. 




Yes 



es 



J-ll 




• For guidance in detormining the whole course delivery system, see Manual, 
pageJ-45, 



• This job aid does not include guidance for completing the Systems Manaqement 
Pfan (SMP) t ;. - 

• For information about what is inciuded in the SMPagd where to obtain guidance, 
see Manual, page J^46. 
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Record CDmniBnts on 
ISD COORDINATION 
SHEET 



During the delivery system selection process infor- 
mation may have been obtained that would be useful 
to persons who performed activities that led into this 
step. Similarly, information may have been obtained 
that would be useful to personi.who will be engaged ^ 
in Instructional Systems DBvelopmeni steps that 
follow this one. 



• Comments are recorded and submitted to 
. appropriate persons, 

• For further guidance, see Manual, page J47> 
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JOB AIDS: 

DESCRIPTIVE AUTHORING FLOWCHARTS 

ISD IIL3 Review/Select Existing Material 



This is the 11th in a series of ISD Job. Aids for use in instructional design and 
development. This volume will direct you to specific guidance, examplesj and references 
provided in the supplementary manual **Job Aid for Review and Selection of Existing 
Material ISD III. 3," If you do not have the supplemental manual, requejt it from your 
supervisor. 
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I SD 111,3 Review/Select EKlsting Materia! 

Q START ^ 



Have 
You Read the 
Introduction to the Use" 
of Job Aids 



Yas 



No 



This introduction provides the user with instructions 
on the basic structure of the Job Aids and guidance 
for their use. 



Introduction to the Use 
of Job Aids 



Refer to Introduction, 




Overview includes: 
= Goal 

- Objectives 

- Product 

- Major Steps 

= Worksheots Ussd 



Overview of Review/ 
Select Existing Materia 
Job Aid 



® For detailed overview, see Manual, 
page K-4. 



6 



Identify the Type of 
Instruction You Hove 
Been Assigned to 
Develop 



Types of instruction may include: 

- a compleie resident, course 
a correspondence course 

- one or more lessons 



- one or more modules 
^ a TEC lesson 
" etc. 



For further oindance, see Manual, page K-11. 



8 



Obtain Reference 
F^eview Sheets (RR) 
A & B 



Record on Top of / 
RR Sheet A: / 
MOS Code Namq 
Skill Level Daiej 
Instruction Under Davelop, 



Reference Revfevy Sheets are contained in pocket at the back of Manual- 

For cKample of what completed RR Sheet A looks like, see Manual, 
page K 7 and K-8, 



Example; See Manual, page KA2. 



rdentifyflnd Record Name 
of Existing Army Caurse(s) 
for the Tasks Von Wish to 
Train 

[Section 1, RR Sheet A| 



At the present lime these tasks moy be trained In one or more course 
if so, name(s) nf Course(s) js recorded. 

For example, see Manual* page K-I X 



10 



Identify/Record Other 
Army Reference. 
Materials 

[Section 1, RR Sheet A] 



• RR Sheet A includes siondarrl Arrny references that should be Bxamined. 

• Any additional sources of u}. iate Army material are added to Section T 
RR Sheet A. 

• For help in identifying and recording additonal sources of Army material, 
see Manual, page K^14. / 




ISD IIL3 Review/Select Existing Material 
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Obtain DA Pom 61V 
DOD Occupational 
Conversion Table 



11 



DA Pani 61 M 1 provides necessary information for converting Army IVlOS's 
into Air Force, Navy, and Marine equivalents, 



DA Parn 61 M 1 replacos DA Pam 61112. If 61 M 1 is not ovollqble, 
DA Pam 61 M2 can be used. 

For further explanation, see Manual, page K-16. 



12 




No 



14 



13 



Guidance in Using 
DA Pam BlMl 
December, T977 Version 



For guidahce in using DA Pam 611^11, 
sou tecluiicul rotes at beginning of 
pamphlet. 



Examine DA Pam 61 1-1 1 
to Identify Any Service(s) 
With Occupationaj 
Specialty Similar to 
Army MDS 
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Did 

or More Service^ 
Have Similar Occupa- 
jional Specialty 



Yes 



No 
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Record Occupational 
Specialty Codes for Other 
Services. 

If None, Record "None" 
[Section 1, RR Sheet A) 



This code designation will aid in the later 
search ftr appropriate materiils from 
other services. 

EKampli: See Manual, page K^l 9, 



17 

Identify and Record 
Appropriate References 
for Other Seryice(s) 
[Section 2, RR Sheet A] 



" For a list of standard references from other 
services and guidance in recording same, 
see Manual, page K'20, 
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Identify/Record Appro^ 
priate References From 
Other Sources 
(Section 3. RR Sheet A] 



For a list of potential references and guidance In recording same see Manual 
pageK^22, " ^ 
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Have RR Sheet A 
Reviewed for Completeness 
end Accuracy 



When all the possible references have been added to RR Sheet A, It is reviewed 
to see if all potential sources have been tapped. 

Sources for review would include supervisor, peers and/or instructors. 



ISD 111.3 Review/Select Existing Material 
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Obtain All References 
Recorded on RR Sheet A 
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Record ON RR SHEET 
First/Next Available 
Raference 

[Col. 1. RR Sheet B] 
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Obtain Pertinent 
Material From CQurse(s) 



Material(s) mav consist of films, tapes, 
textbooks, graphs, pictures, over-head 
projections, etc, 

for guidance in obtaining materials, 
see Manual, page K^25, 



Fur guidance In obtaining references, see Manual, page K-26, 
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Record Reason for 
Unevaiiabiiity 

[Record Under *'Com^ 
ments", RR Sheet A] 



The reason for unavailability is recorded so 
that someone else working on this block in 
the future will not waste time looking for 
references that are no longer in print, etc. 



EKample: see Manual, page K^27. 



• This block begins the process of identifying materials for approprietineis to the 
instruction being deweloped. 

• Work is now being done on RR Sheet B, The following is also recorded: 
= MOS Code ' = Date 

Skill Level - Your name 

• fxample: see Manual, page K-28. 
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IS 

This ReferBiico j^p 
a Ciitalog/lndex 
etc, 

V 




11 



itientify "Entries" in 
Ccjialog/lndox, eic. That 
Appear to be Appropriate 
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Rocord All Appropriaig 
EntfiDS {Name, No., eicj 



Obtain Materials Recorded 
in Col. 2 of RR Sheet 8 



r 




• Refurencos are of two types: 

1) Catalogs/indexes, etc: these contain only 
' descriptions of material which will be obtained 
later. 

2j Items of acioal material: which will be examined 
later. 



For guidanco on how to find material in reference source, see Manual, page K^29, 



Name, number, etc., of potential material is recorded so that material may bo 
obtamed for further evaluation. 

Example: see Manual, page K.=31. 




• For guidance in obtaining materials, seo Manual, page K^32. 



• 5 
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ISD 111,3 Review/Select Existing Material 
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Record Reason for 
Unavailability 
[ Record Under "Com^ 
menis", RR Sheet B] 



Example: see Manual, page K^33. 
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Scan First/Next 
Availoble IVlaierials 
[Col, 1 or 2, RR Sheet Bl 



This block begins the pracess of scanning material to determine if it should be 
held and examined in depth at a later time. 

For guidance, see Manual, page K^34. 




Enter a "N'' in CoL 3. 

Record Any Approprjate 

Comments 

[Col. 3, RR Sheet B] 



An "H" meaning "No" Is recorded to 
designate an iiem of material which appears 
to be of no further value for the instruction 
being developed. 

Example: see Manual, page K'35, 
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Enter "Y" in Col. 3, 




Record Any AppropriatH 




Cumments, 






(CqI. 3, RR ShBBi B] 
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A "Y" meaning ''Yes*' is recorded to designate an 
itum of moterial that initially seems appropriate 
for inclusion in instruction and therefore should 
LiR held for further evaluaiion. 

Example: see- Manual, page K^35. 




Examine First/Next 
Item of Material 



39 



Determine/ Record 
Acceptobijity of Item 
of Material 
[Coh 4, RR Sheet B] 




• This Oh, r ifns the process of an In^deptfi review of sefecfed materials, 

• Usefulness of materials is judged according to how consistent an item of 
material is with pre-determined: 

Learner characteristics - Delivery system . 

- Learning guidelines = Management pjan 

• Fui lurther explanation, see Manual, page K^36. 



An item of material may^e: 

- Accepted as is 

- Rejected 

- Revised 

For further Information and example, see Manual, page 



No 



K.IO 



ISD IIL3 Review/Select Existing Material 
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Recprd Suggiisted 
Rflvision 

[Back of RR Sheet Bl 




43 



Submit RR Sheet B 
to Supervisor for 
Review 



Any 

fnfQrmetion foF^ 
individuals Working in 
Other ISO Blocks 

7 



Yes 



C 



45 



The reviower of existing materials records the 
revisions he thinks are required if material is to 
be used, Personnel rGsponsible for cost decisions 
wiillater review these suggested revisions. 

For exaniplBj see Manuai, page 



Record Comments on 
ISD COOROINATION 

SHEET 



During the review and selection of eKisting materials 
information may have been obtainted that would be 
useful to persons who performed activities that fed 
into this process. Similarly, information may have 
been obtained that would be useful to persons who 
will be engaged in Instructional Systems DevBlgpmint 
steps that fallow this one. 



Comments are recorded and sObmitted to 
appropriate persons. 

For further guidance, see IVIanual, page K44. 



STOP 



79 



^ JOB AIDS: 



DESCRIPTIVE AUTHORING FLOWCHARTS 

^ ISO IIL4 Develop Instruction 



This is the 12th in a serios of fSn Inh am r ^ ^ 

developmont. This volume- ^ d^ec^^ut ^^i^"7'H design and 
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ISO 111.4 Develop Instruction 



Hava 
You Read the 



IritroduetiDf 

of Job Aid 



the Use 



No 



Yas 



• This introduction provides the user with 
instruction on the basit structure of the 
Job Aids and guidance for their use. 



introduction to the 
Use of Job Aids 



• Refer to Introduction. 




Overview of Developing 
Insiruction Job Aid 



Overview includes" 
^ Goal 
= Objectives 
- Prnducis 

- Mujur steps in process 

— Worksheets used 

- Descriptive flowchart 



• For detailed avervievv, see Manual, 
page 



81. 
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Outputs of ISO 
%Phase II Qfid jj 




Guidance for Obtaining/ 
Preparing Outputs of 
ISO Phase II and III 1 
Ill.Z.and III 3 



In order to develop instruction it is necessary to have 
the fnllQwmg inputs: 
- from ISO Phase II 

3 parts learning obleciives 

carrespOnding test items 

learning category and subcategory for each object've 

• correspandrng learning activities ^ ' " 

• managefnent plan and delivery system 

• selected existing instructional materials 



» The outputs of the 4 blncks at ISD Phase II and 
IM.1Jlh2, and IIL3 should be available from 
persons responsible for those actiyiiip. 

If procidures for any of these activities were not 
complete Job Aids; u^/scriptive Auihormg F-iw^ 
charts may be referred to as follows: 

- Develop Objecriv^s, pages £^3 fhru E 13 

- Develop Tests, pages F^3 thru F Oo/ 

- Sequence and Structure Objectives pages H 3 
thru H 00. 

Learning Categaries/Activities, pages 13 thru I 

- ivianagemen! Plan/Oelivery System -panes J-3 
thru J^l^ ' J 

- Select Existu.Q M^ierlals, pages K 3 thru K 11. 



00. 



Begin. Process of 


Determining 


Resource R 


equirements 


9 










This block begins the process of identifying^ 

instrucfional needs 
= resources 
= cQnstraints 

Process is accomplished in blocks 9 thru 13, 



Instructional needs are determined on the basis of previaus analv.P. .nH 
plennmg which took place in ISO Phase II and m: " ' '""^ 

For further information, see Manual, page L-IK 



Study Types of 
Resources and Cast 
Factors for Oevelapmg 
Instructicn 



For types of instructional resources and cost Actors, see Manual, page L 



12. 



L-4 



Qq 



ISD IIL4 Develop Instruction 
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kleniify Resoiirnus 
Availabiii for Instruction 
Presently undnr 
Onvf}!fjnn:''! it 



17 



/'Da \, 
Tnu Knuvv tluj 
FudCtions of the 
Pruduction Pursamiol^ 
Your SchoaL 
\ 7 . 



Yds 



4 



flfVii!') Tiifniinat LfKi 



© For guidaiiCG in idGntifying pvailahlG resources, sgg Mammi, pagf^ L'15 
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Hoviuw Functiniis ot 
Pruduction Personnel 



For description of fuiictioos of thei 

- media spGcialist 

- graphic artist 

- print specialist 

- photagrapher 

- audio producer (ennineer) 
-- tenhnician 

For further yuifiLincc, see Manual, payu L=1 



1 LO's nie iiuliuify sorted uitu iwo yruups; 

A) ihnsn frir wl)ich unstfnctinfial maifiriall^'arn nvadahlo 

B) those for Vshicfi instruntiunal rnaierials must now be drjvolopud 



Fur ftjrll 



iffirrnrHiofK rs-.^' MnfiM;!', pEitio L IB. 



© 1 ii)''^ tijf ^%[';f;h irw if}!.tfU{;ti;jn iituU he fhivnitipfid now 'U-il ducnrthny tt) 
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SelBct First/Noxr 
Group of LOs fnr 
SpecifiBd Polivery 
System 



A oraup of luiirmng objucrives for a particular delivery system is sQiecied. 
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BBgifi Pracess of 
Duvolupinq Ftist 
Draft 



This block begins the actual tlDvelopmfint of instruntinn. 



nbtain InstructiQn 
Dnvefopmont (ID) 
Cfi9cklist 



Instructipn Deyelopmeht Checklist is used to dacument Steps in 
preparLHiori of first drjft materifils. 

For guidance in obtai.iing ID checklist, see Manual, page 123. 



19 



Record IdentifyiFuj 
fnlurniation 
[ID Chccklistl 



Identifying information includos: 

- Your name/Office symbol 

- Date 

- Course/Madule under developmont 

- MOS/Skill Level 
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Tuliyeiy System\ 
<^for This Grnup of LO^ 
Aufho U/riy 




ISO jlL4 Develop Instruction 




DBtBrminc/Check 
Techniques to StiiTiulute 
Audio Sense 
[ID ChGckiistl 



© For further informaiion, 



suu fVlynuoI, 
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Prupare/Check 

Lean Script in Correct 

Format 

[ID Checkhstl 



For fuithu! mfurmulion, see MdhuuI, 
page L=26. 
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Review/Chuck 
Scripi for Continuity 
[ID CheckNstl 



© For further informution, see Manual, 
pEige 
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□eterniine/Check 
Pticincj of Presentation 
and Indicate on Script 
[ID Chocklistl 




For further information, see Manual, 
paye L-28. 



ERIC 
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^^^/^ Del ivory "\ 
^"'SyStuin fur Tins Group "^-^--^ 
\of LOs Audio Vi:unl^-^ 
\4Sliile-Tape)/ 



Yes 



No 



Oil- 



j e Fuf turliiHi infuffiifidiji), ^un M^ifninf. 



Ji 



Plm Usu uf V!:aKib 




Bnyin Prnflucnnn of 



^ For lurthor ;rifnrmntiui ufid nuinunno, 



This block IjRgins thn nctiml prnduniinii nf 
The uurJiQ visual lusson. 
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i PrBpnni/Chnck 
Storybnnrfis 
[ID Checklistl 



30 



of Storylnjtircls 
(ID Chu[.k!istl 



e Rpunh sketi;!!!-:. or stick rigurns arn nallsd 
storyboards. 

3 For lurihur iiifarmuiion and guirianLB- see 
Mnnnal, page L^32. 



F {)f fiii 'f infnrniution cind guidanne, SGD 



iSD !IL4DHvojop instruction 



^^^'^ Do! ivory 
^/Systnni for This Gruufr 
"^.^ ,,t I ih Wfitt'Mi 
Tnxt 



31 



22 



Curnfionf^tits by 
Cfinsuiiuiinn with 
PhniOfjf jphor/Arti:;t 



33 



34 



Indicutn/Chnnk 
Slidf; Cluingus 
ILD Chncklistl 



\ 



uo to 
3!nnk 
43 / 



■vuiiiuni, piiCifi L-3ij. 



Fur tii[il]ui WW.}] - itiliun unti tju:flant;t!, ^flu 



© Fnr fiirlhnr infurniutinn nnd nuiciaiinfj, 
Munuui. pyya 1^38. 
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Use/Check 
Sinipiu Words and 
Short Sefuenctis 

[in Chuckiisi] 



^ For furtfier infurniation and guidance see 
Munuai, page L^39. 
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Usfi/Chnck 

PBrlurmance^Oriented 
Writing Siyie 
[ID Checkiistl 



^ Fof furihyf infofrnatfun and guidaficc. 
Manual, page L-43. 




Main Points in Text 
[ID Chucklist] 



rar furtlier information and guidancG sec 
Manual, page 
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DuyBlop/ChGck 
Ideas Clearly 
[ID CheckMstl 



* For fiirther informatian anci guidance see 
Manual, page L-49. 
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Dovofop/Uso 
Cloar Fr^rmat 
IIU Checklistl 



r 



* Fur further information and guidance, see 
Manual^ pogo L-51. 



C n 



ISD HI. 4 Devejop Instruction 
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Us!j/Chock 

Fnfmula to Duierniiny 
Roatiing Grncie LrvcI ejiul 
Ryco! ii 

[ID Ciiocklistl 



Tlio Reydifui GradG Lyvel Fuimtila is usKti to 
keep the wr itiiig at u love! (ippropriato juf tlie 
targoi popuhitioii. 

Fur furtliur ififorriintion und yuKlunCB, Sfiii 
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Adjust Reafliiu} 
Difficulty Luvul 
if Necessary 



43 



Attach ID Checklist in 
First Draft Lesson 
Maibrials and Submit to 
Supofvisor for 
hiiiials/Camnierits 



44 



Supervisof check useful f nr obtaining another person's opinion of the hjsson, 
and for duublu chucking the iiunis on tlie ID Cliecklisi. 



Do \^ 
You Kriuw 
How to Conduct 
Individual Validation^ 
Trials 
? 




No 



Individual Validation Trials are also known as 
developmental testing. 
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Read Job Aid for 
ISD Validote 
Instruction 



This job aid does not cover individual 
validation trials. Ttiis topic is covered in 
another jnfi aid. 
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Co/ujuc! Indivifluui 



47 



Requirnd 




48 



Aycurdiofjiy 



The individuul v^ilidutio!! frinls will rnvRnl ony 
«voaknessen or defiuioiiciys m tho instfULiional 
muterials. 



Ifistructional niaturials are revised 
tincording to informutlcn cullucted \u 
tfiR validation trials. 



49 



r^evolnp 




Insfrucifjr's 


GlIljM 


50 








Stiiduiu Gill 




1 





o This job aid du.s not com thu devilopment of a„ insiructor's quidP 
TRADOC Pam 350.30, Black 111,4, Oevolop Ins.rucnon, covors this fpi 



« Tim job oid dons not cnvDf iho duvGloprnDm of a sitidcnt guide 

. TRADOC Pam 350-30, Block 111,4. Dovolop lns,,uc,i„„, covers this topic. 
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ISD III. 4 Dovfilop Instruction 
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Submit in Sup!jrvt:;uf ; 
s ' Lesson 

© Irntfiictnr's Guiilfi 



SiipBrvisnr d]uck wituiUsil a\ tins [luifU, Ijufcifu f(u..i;riuts (Jo into final 
pruducnui) = 



5'Z 



ififuf fTUitiun 
U)] Individuals WorkiMq 
\ in Other ISO 
\. Btnnk^ ^ 



No 



Yys 



^ STOP ^ 



5a 



Recurci Canininiits 
nn ISD 

COORDINATION 
SHEET ^ 



DuFffifj tlifi instr!ir:ti(}fitil fjn\/nlnntnRnt nrncyss 
ififuinidlmii rnuy liuvu bCiun ubtijinGfj thut wauld 
bu iisuful !n pftrsnns who fjnrforfiiud ticiivrlies 
that ffifl tiilu tfiis niie. Siniilnrly, information 
inuy iiuvu bufjn abtijiriuii ihui would bo useful to 
p^irsyiis why will be f}fi(|Jiyyd in InstruciiDnol 
Sysioms Duvci 'imcnt stt?ps that follow this one. 



Cofnoierils HfCi rocordyd and submitted to 
appinprintn persons. 

For furtiier guidance, see Manuuf, 
pap L u2. 
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L.13 



ERIC 



JOB AIDS: 

DESCRtPTIVE AUTHORING FLOWCHARTS 
ISD III. 5 Validating Instruction 



This is tiu* i;kh in a surii's of ISU Jol) Aids kn ubo in inHtructioual doHim ^incl 
clt'Vc^lopnvMU. ThiH volnmo wiil diinHa you to sppcit^ic guidanco, oxaniplc?s, and refcTOiun^y 
provuliHl in ihv supplonunitary manual "Job Aid for Validating Instruction IHD II 
ir you (in not havu ihv Hupphniicntary manual, nTjuust it i'rom yoin* yupurx isor. 



■ • Do 

M-l 

o 

ERIC 



ISD 111.5 Validatifig Instruction 




^ Havn \ 
^' Yuii Riidd ihn \ 
irodiiRtion fo tho U^if 
ul Job Aids 



T 



Yfis 




\lm\ to 
Sou uii u .^/viuw of 
. the Job Aid 




« Tfiis ititf oductiufi prnvidtis the usur with 
iiisiruction on ihs^ hjsic structuro of the 
Job Aids nofl guidunco 'ar ifieir usu. 



Introductian to the Use 
of Job Aids 



-J 



e Refer to Iritrpductioii. 



Overview iiiciudes: 

- Goal 

- ObjoctivES 

- PrDductS 

- Major steps iii process 

- Warksheets used 

- Duscriplive flowchurts 



Ovurviev^ of VaHduting 
Instrtjctiori Job Aid 



For detaijed overview, see IVlanuat, 



page M4. 
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M-3 



ERIC 



tJ ' :J! [■ !!! ,1- i.Utii]!. 

^ihfMjf Inilividu.ii 



D^ii!!i!!nh 

NficuH-iity lur VLH'Elntiun 

Prufiur hnti; t;, v^iiddU- 

linpfji lafico fj! luedijuuk 

Huw vnfidntjOii fii^ips tniprcwi; instruction 



[-n\ rilVflPfMfjforinnfinr 
M^y thru M-iO. 



^> insHLiuliun V.siifkitKjri Hucoffimrj bhmn - jnclividu^il (IVR SfiEiU! Indiv.j is used 
fn rincinnf>nl rht? Indiyidiiai TriaKs^ Vnlinnfipr) prpi^?:;^. 

^ Fni quidanf:u in nbtainin-: iVR Shunt -Imliv, soe Manuai, paf|Fi M = 1 L 



10 



Study Gijitl^jlines \ v. 
V^ndutif}!} Usin(j 
Ifidividm' Tn.]i 
Evaluation(s) 



IfirnrfTKUinfi inniiulnff in Si^.LiUEi i i:, a.. fnllu A": 

- Coursu MOS Cnde 
Skiil InwGi 

iiiSiriw:ii(3n undnr dfivylopniiHU 
hivifijctiufi \m\\'\[\ yiilidiHGd 

- hufividuaj Vnhdntion Trial Numiipr 



l;rir guidHOCH In nimplfitmy Sonnun I of IVI^ Shuni - hidiv., spfi Manunl, pap M 12. 



Guidulinti:^ uxplijin the pronnss nnd pmceduf usod in, u vnlidutini' nnd irsmn 
n single tr^jnien m n subject. 



^ Fur fiirthfir infurniution, sue Mnnijiii puyo 



"Inji hvui: ' ' 



1? 



I. ()■;!!•). /- ii- 



:!!■■ i...' in^: ,■(;!] 



13 I 



MuthtjcK^;] r = . lis- 



i in 



wit i on 



14 



IVRShfHjf in.hvj 



IB 



Pffjfiarij Vfjiifiritinn 
Rf!f:uf flifiq ill fnfs) 
iVH Fnrmi) 



^ For turllinr [juifianct?, sun Miinihii, p;if|t} M-PO, 



Vnlifjntitin Hficnfriiiii. 
nuostinfiiinire^ 

- Atlitiifin Sculus 

- liHi^rviiiw \ nnm 
ObscifVatiDii Fnfnis 



if)[:(Lidr 



^ Ot ytiiduncii in prfjp.irinn Vahd:itiun RucnrdMU] Fnrini=, sou Miinual, ptitie M-21. 



ERIC 
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Protein IflSlrUf:t!iif!i]| 

Mtiteriyl to Trinriiifi 



17 



AdniinistMr/Rncorti 

RespDiiSfiS [ill VR Furin(s) 



Arialyze VR F(Hm(s) 



19 



Rocord Results of 
Evvilijarion 
[Section II, Block D, 
IVR ShoBi-^lndiv:] 
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Deterniinff if Addihunnl 
T'uifiee is NeDded Prior 
to Revisiofi of 
Instruction 



MHihuds aru discuss&d fyi presyntafiufi uf inutiiitninnul liiuiuiid! Tliny ii 
- WliD shoLdd present the :nutfifial 
-- LuLiHtiuii (site) far presofitotipn 
■ AifHuifii nf fTKitEJfin! to bu [ify^niitrifl 

For fiirlher ifif orniytian, sf;G Manudl, pG(|u M 25. 



pBrson(s) conduciiny (lu- yalidatinn (e=f)., respunsiis to an iriiervitw). 



Forms m\i analysed far purturns of responses or othRr infnr ninrinn infllcnfivfi of 
wiiutfier or nut levision of materinl is njcessnry. 



Following are examples of types of infurmniion that should he rucofdcd: 

- Paiteriis of cnrrfict arul incorrni:! responsus. 

-= Indicoiioiis of probloms areas within the instruciiGiuil matenaL 

Trninees coninienis, where applicahla. 
=- etc. 

For furiher fjoidance, sue ManuaL puije M 27. ' 



For Guidance in deterfTiininy if afi addifionnl train^n should fie uKt-d in 
evaluate the Histructional niateriul, sue Munual, pntju M 28= 



ISO IIL5 Validating Instruction 




No 




Is \ 
Revision of ^\ Mg 
Instructional M^ittri ^ 
Requiruci 






Yes 


\ 

\ 

\ 

■ \ 




\ 

\ 
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\^ 

Record Surnniary of 
Required Revisions 
(Section 1(1, 
IVR ShOBt-lndivJ 


25 




Revise instructional 
Material as Necessary 
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Record "No Revisiun 

Needed" 

[Section I ii, 

IVR SliL^et-^lndivJ 




For example, sec Manual, page M^29. 



Fur tixiiiiiple, see Maiiual, page iVi=30. 



Revisions will narmally be made by the individuaKs) who developed the 
insfruction being evaluated. 



07 
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Ohtijin Suporvisuf 


Apprnvni iM RGviSiuns 

i 


27 




Rntofd Ui\U\ RevisiOfis 


CompiLMiid 










IndivJ 


28 




DGturmiiui if 


AdditiuiujI 


INDIVIDUAL Validatmn 


Trial !s NDfiiif3tj 







Fur uxQiTipiu, &m Manuul, pucju IVI 31 



e Whyn f£iv!Siuns rusiiliiny Ironi iho prcvinus Individual VLilidatiun Trial wn 
exteiisivo, an additinnal Individnaj V:diilniion Trial may be desirabln. 

© For inforrT^nnnn and guidanco, seu Manual, page IV1-32. 



/ Additional 
<^ Evaluation of RGvisions 
" Nnuded 



Yds 



30 






Obtain New IVR SheGt- 




Indiv. and Cnrnplfiin 




Section 1. 
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ISD IILB Viilifiating Instruction 
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Stutly Guiiloliiifis fui 
Validniiiin Us'iifj Gffujp 
Trial tvuliiiHiUfW w 



J tjruLii) d! iroiiiCtis is usimI id jjv.ilujiii tfui muiriuiiion rn.iitHi 
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ComplDic S -ntioii I of 
Insrruciinn Vnhriutinn 
Recorrlino Sh«of=- Gf niip 
(IVR Shfiet-Grnup 



a inKtriJctiun Vijlitldtion Rficnrclii 
IVR S\m\ Indiv. 



r lil !.:Adrn[iiu, SuB i 
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Bfiyin GROUF 


' Trial 


Evaluation of 


IrisiriJCIttjn 


Usinn Fifst/Nf 
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Rucnrd ISD R.rsnnnul 
CnntjuctMHi EvalUtfttOfi 
ISaCtmn II, BInck A, 
IVR Sheo! Grp) 



Thts b\in:k hfifjins llm Group Vjhddtihn Tftol(!.) pruiiu! 



• Tiiu naniu antl Uff]afi!/aiiofi of ttui nHjivKlnjIis) nonflijciiot] thn nvnlit-JtOfi is 
rjfLurdtJcl. 

• For tixanwile, suu Manual, pafjo M 37. 
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Selcci/nncnrd Validntino 
Melfrod(s) In bu ikpji in 
Evaluatitin 
IScciion II, Block B. 
IVR SfiDfit- Grpl 



The validation niolhodis) usod in Group Validntinn Trials arn tfie snnir] as for 
Intlividual Vafidatujri Tnals. Thny arn: 
■ Tests - Intnrvinws 

Q u ns! i onna I res 0 f)Sorva 1 1 n n 

- AititudD Scales Otlnn rnnifiiicjs spucific to tfifi trninirig situations. 

f^nr nxarnplu f]f liow to ret:nrtl vahfirjiioii rnet finds, see Manual, paije.fVI-38, 
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Soicct/Rc3cuicJ Group to 
bii Usufl in Evdluutioii 
ISnntion II. Binck C. 
IVR Shoot-Grpl 
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Pi U pure Vtiiirjiilu.Hl 
Rcrnrdiruj FDrni(s) 
(Vk Form) 
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Presnrit Instf uctiontil 
MatGfijj IQ Group 



Gfoups of tftiiiiut^s win] iwu ro[if QstMUntivf; nl \\\u taiiitil pfipuintitjii lift; 



- ■ M nn 



Vuliiluiiun Rucuifliny Furiiis fur Grnup Vaiitlution Triiil*^ d\u DSSiHitially 
tlifi sciniG as fnr hulivicitiul Validaiion Tnnls. Tliny nii^liifin: 

- Qijusiionnaircs 
Aitiiudn ScnUiJf. 
IntGivjfjw Fornis 

- OhSEjrvuiian 

Fur guiEloncf^ iti prnpnring Validniinii RuunirliiU) Forin^, SCO MiUUiuL puiji] M 40. 



Motliods arn disnustiuii fur prnstMitation of Ihc insiiiiciuiiinl niateiial lu n 
group of iiuinces. 

For fiirilier infori^uitiod, suu jVlniuial, pagu 
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Adniinisiur/Rocnr H 
RuspodiiU^ on VR FoFrn(s) 



Forms ftuiy t)0 U\Uh\ nut by irninnii:^ (iittiturlu scalt)), iiisiruntor (comments), 
vnl!{lnia)n ttiuni (intufviuws). 
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Annlyzfj VR Forin(: 



• Forms nre uriaiy^nrJ for pattnrns witlim tho grntip or ntlirjr iof ornuHiuii 
mrjiccitive of wlicthnr or no! rnvininn n^ mniniin! is nfinnssiiry. 



100 

M.IO 



iSD II Kb VajjcJoting Instruction 
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ftecord Results qI 
Evaluation 
[Section II, Block D 
IVR Sheet-Grpl 




• For exnmple, see Munuyl, pap lVl-45, 



» For yuiiluncG, suu MaiUjal, pngi> ' ' 46. 



Gd to \ 
Block ) 
33 J 
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Reuufd "Nn Revisiuii 
Nofitletr' 
ISfiCtiQi! Ill, 
IVR Shoot - GrpI 








For mm\\M, see MrifuiaL puyu M=47. 
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t[!!i ii(:.) Ahn ilrvi'liipi' 



i flf;:.iiM hiMH f vi .rf 
! 

L_^„. 





Cnffiplt^ifHi 




[Cucfinn HI 




IVR Sfiont 


Gr[]i 










DetcriTiinii i 


Additional 


Gruup Vn!itlf}tfun Ti lul 


is NffOrjfMl 









When revisions rGsultini] frorn the pruvintis Grutip VDlidijtion Trial wcrn 
(ixiensivu, [jn afhlitiunal Group Viilrdritinn Trinl mtiy bn dusirobic. 

For fufthEif ififorrTinlion and gniflnncn, sen Nlmunil, pngn M fi2. 



MLD Vnjiilfuint} Insiriintlon 



^ A^;!!:I:^■:^'■ 
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Ubitjiii Wfjw 1 VR Sh-'fUf 


Gtp tiiifi Cui 













Sutjinil CgM 






Super VI snr 
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Ifif uf riuilHjfi \ 
for Ifirlividiiiifs 
Wijfkiny 111 Qthtir ISO ^ 
Blacks 

9 
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Recnrtl Cainr^Hjiils on 
ISD COORDINATION 
SHEET 



Oiiriiiy tfin i[Btrut:|inn vnliilijliun (iiucuss iriforni.ninri 
may havn buuri nhtanrni! \\\\\\ wnuld bii iisDful tn 
(jnrsnns who pcKlarmnd iH:u\.i; u^ Ifun fed into thu 
iiisifiicimn Valiilnliuri pmi irbs. Siindnily, ifdofnialiuii 
[liny luive benn nbtuinud tiuii wnuld ho usGfiil tn 
pursons whu wi!l In? LMirjuycd in Instructiniicil Systi?nis 
DfivulnfiiiiGiit faups \\\\\\ inikjw tins one. 



« Cnf : ills ij [fi fucnf dod and subrnittDd to 
uppiLipriate pRrsons. 

• Fur furtliur QiiitliKicn, %m Manunl, pago M 55. 




